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ABSTRACT 



The invention pertains to a process and a device for the 
speech-controlled remote control of electrical consumers by 
means of speech commands entered via a standard, com- 
mercially available PC (1). The PC (1) stores the control 
sequences for the sequencing control of the individual 
electrical consumers (21, 22, 23, 24, . . . , 2ri). The control 
sequences are infrared-encoded signals enabling any elec- 
trical consumers featuring an infrared remote control unit to 
be controlled. Units which do not feature a remote control 
unit can be at least switched on and off via an upstream 
infrared receiver. A graphical user interface which is capable 
of being displayed on a monitor of the PC (1) forms an 
image display which is assigned to each individual electrical 
consumer, said image display being capable of being 
assigned the respective speech commands entered and 
infrared-encoded signals (FIG. 1). 

11 Claims, 4 Drawing Sheets 
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Fig. 1 
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Fig. 2 
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Fig. 3 
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Fig. 4 
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PROCESS AND DEVICE FOR THE SPEECH- (ANONYMOUS)) suggests two different systems for a 

CONTROLLED REMOTE CONTROL OF remote control or telecommand system based on infrared 

ELECTRICAL CONSUMERS signal transmission: 

BACKGROUND OF THE INVENTION a) A portable, keyless remote control unit transmits infra- 

This invention relates to a method and apparatus for 5 red or radio remote control signals to electrode equipment 

remote controlling electrical consumers by way of speech Wlth the remote contro1 commands being entered by way of 

commands, the following being featured: a standard, com- s P eech in P ut at the remote conlro1 unit rather than b y wa Y of 

mercially available personal computer (PC) serving as the keys. 

CPU which receives the speech commands, recognizes them b) The second system suggests a stationary base unit 

and transforms them into control commands for controlling whose functions are the same as those of the remote control 

the consumers, a minimum of one speech channel with an unit mentioned above. The stationary base unit is located at 

electro-acoustic transducer which is connected to the PC via a place from which the unit to be remote-controlled is 

a speech channel interface, and a remote control network visible. In contrast to the portable version a), the stationary 

which is connected to the CPU and the consumers, in unit is capable of receiving speech commands inputted from 

addition to a standard, commercially available speech rec- 15 a distance, e.g. through the telephone network, 
ognition program being implemented in the PC. 

Such a process and a device are known by virtue of the OBJECTS OF THE INVENTION 

published German Patent application DE 4 214 668 Al. Therefore, it is an object of the present invention to 

Standard, commercially available personal computers in 20 provide a generic process and a generic system for the 

the form of economically priced speech communications speech-controlled remote control of electrical consumers 

systems have been offered recently for communication with sucn that the PC serving as the CPU is able to transmit the 

the computer. The remote control system described in the remote control signals in an interference-free, cost-effective 

above-mentioned German Patent application DE 4 214 668 an d reliable manner to various appliance types, which may 

Al takes advantage of this to generate the control signals 25 be located in various rooms. 

required for the remote control of connected electrical Various othef objects> advantages and features of the 

consumers with the aid of the speech recognition system m {nvcntion wiu become readil t from the 

implemented in the PC. This process also utilizes a graphic ensuin deUiled descriptioil) and the novel features ^ be 

user interface (GUI) on the PC monitor for displaying a code ticularl inted out ^ the ded claimS( 

word for calling stored individual settings for the respective 30 

electrical consumer. SUMMARY OF THE INVENTION 

The citation (DE-A-4 219 106 DEUTSCHE AERO- 
SPACE AG, 16th Dec. 1993, Abstract) pertains to a speech- In accordance with this invention, a technique and system 
controlled information and/or ordering system featuring a f° r remote controlling electrical consumers in response to 
central computer, the central computer being equipped with 35 speech commands. A PC connected to a remote control 
a speech recognizer and a central data storage, as well as network encodes every speech command generated by the 
featuring at least one speech input/speech output device, speech recognition program in the form of infrared code in 
said device being connected to the central computer by a accordance with the speech command received, and outputs/ 
telephone network. In order to improve the flexibility and transmits the infrared code to the respective target electric 
efficiency of such a system in the handling of the dialog of 40 consumer via the remote control network. The infrared code 
the caller with the central computer, this publication sug- received by the respective target electric consumer is then 
gests that the speech input/speech output device be spatially transformed into electrical control signals, 
assigned a display unit which is connected with the central Preferably, the infrared codeset may be entered, modified 
computer for the purpose of visually displaying the infor- and assigned to a particular consumer via the PC. 
mation conveyed from the central computer. This speech- 45 Depending on the specific application of the system 
controlled information and/or ordering system does not embodying the invention for speech-controlled remote 
comprise a remote control or telecommand system. Trans- control, the remote control network connecting to the indi- 
mission of infrared signals is suggested exclusively for vidual consumers may feature a star topology or a bus 
communication between the speech input and output topology. 

devices, e.g. between a modified telephone terminal device 50 In iddilion> the remote control network may als0 feature 

and a isp ay unit. a fi ber0 p t j c cab i e v f a wn i cn the infrared control codes may 

Many electric household appliances on the market, i.e. be transmitted directly, 
consumer electronics units in particular, can be remote- 
controlled nowadays using a small-sized, easy-to-use remote BRIEF DESCRIPTION OF THE DRAWINGS 
control unit by means of the transmission of infrared signals 55 

to the electric appliance. Such a remote control unit of hi-fi ^ following detailed description, given by way of 

units, for example, incorporates a great variety of different example, and not intended to limit the present invention 

functions, e.g. switchover from stand-by mode to continuous thereto, will best be understood in conjunction with 

operation, channel selector, loudspeaker volume control, etc. the accompanying drawings in which: 

Infrared remote control units of this type have shown 60 FIG- 1 is a block diagram of a system embodying the 

themselves to be particularly reliable and not susceptible to invention for the speech-controlled remote control of several 

malfunction. However, infrared remote control units are consumers featuring a remote control network with a star 

designed for operating only a single unit or a group of topology as the first embodiment of the invention; 

functionally associated units, and remote control extending FIG. 2 represents a second embodiment of the system for 

through a number of rooms is not possible. 6 5 the speech-controlled remote control of several electrical 

The citation (DATABASE WPIL no. 92-055 708, DER- consumers in which the remote control network features a 

WENT PUBLICATIONS LTD., London; & TP-A-19 201 bus topology; 
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FIG. 3 represents a third embodiment of the system for advantage of the cable installation work/expense and the 

speech-controlled remote control in which the remote con- susceptibility to interference of the signals transmitted being 

trol network provides for the transmission of infrared signals less for large -size systems. This is particularly the case when 

via a fiber-optic cable; and it comes to remote control systems featuring a large number 

FIG. 4 represents a simplified embodiment of the system 5 of consumers which may be distributed over a number of 

for the speech controlled remote control of several consum- rooms ^ ihia the same building or over several buildings, 

ers in which the consumers are merely switched on and off. Another variant of the speech-controlled remote control 

system embodying the invention is depicted in FIG. 3. The 

DETAILED DESCRIPTION OF PREFERRED setup of the PC (1) is identical to that shown in FIGS. 1 and 

EMBODIMENTS 10 2. However, the interface (17) leading to the remote control 

T . „ . - . , , , . ™ „ ^ , , network contains an infrared transmitter so that the infrared- 

In the first embodiment as depicted in FIG. 1, an electro- . , . . , . , . ... , c n ^/i\ 

/<Am . v , . ' , , encoded remote control signals transmitted from the PC (1) 

acoustic transducer (100) is connected via a speech channel . ,,. . t c . . j .l. u cu 

- , v 7 4 t . i / * via this interface (17) can be transmitted through a fiber- 

interface (14) and a remote control network (50) via a J ( </ d y{a f (M 

remote control in erface (15) to a standard PC (1) routinely 1S £ 93 * * ' ^ lransmission ^ 

featuring a CPU (11), a monitor (12) and a keyboard (13). ^ TCC J Qiy J trs m 32 33 34 3«) assigned to 

The electro-acoustic transducer (100) defines a speech chan- t , v * ' ' ' ' " ' f B 

* u . ■ i ♦ a • *u the consumers (20). 
nel (110). A speech recognition system is imp lementedm the .„ r , „ , 
PC(1), the system recognizing the remote control speech A simplified topology of a speech-controlled remote con- 
signals transmitted to the electro-acoustic transducer (100) M trol system embodying the invention is depicted in FIG. 4. 
via the speech channel (110) and from there to the CPU via ^ s P eech commands entered via the PC (1) here merely 
the speech channel interface (14), said system also being serve to switch individual consumers on and off. The speech 
capable of conveying the information obtained through recognition system implemented in the PC and the infrared 
speech recognition to other programs. A standard, commer- codeset stored ™ the pc ™ also accordingly simplified in 
cially available software package is preferably implemented „ comparison to the embodiments described above. Power 
for speech recognition. The connection of the remote control supply lines (71, 72, 73, 74, . . . In) lead from the individual 
network (50) to the remote control interface (15) of the PC consumers (20) to the switching contacts (81, 82, 83, 84, . . . 
(1) features a star topology. This means individual separate 8 ") of the all-or-nothing switching relay (80), the switching 
wiring systems (51, 52, 53, 54, . . . Sn) are routed to the contacts being preferably provided for in a central switch 
electro-optical transducers (41, 42, 43, 44, . . . 4n) in a star 30 cabinet (8). A remote control network leads to the central 
topology, the transducers transforming the electric infrared- switch ca bmet (8) from the PC (1) via an interface (2), the 
encoded signals transmitted via the wiring systems (Sl-Sn) Delwork enabling a simple point-to-point connection in this 
into optical infrared signals. These infrared signals are case - This point-to-point connection .consists of an .electrical 
conveyed to the infrared receivers (30) via an infrared wiring system (6), an electro-optical transducer (7) acting as 
transmission link (3), the receivers being respectively 35 an infrared transmitter an infrared transmission link (3) and 
assigned to the consumers (21, 22, 23, 24, . . . 2n). A switch an i nfr ared receiver ( 9 )- ^ remote contr ° l , si g nals co L n " 
(SI, S2, S3, S4, . . . Sn) is shown in each of the consumers veyed via this simple remote control network act on the 
as the element to be controlled. It goes without saying that all-or-nothing switching relays (80) for the purpose of 
the switches depicted as the elements to be controlled only switching the power supply lines leading to the consumers 
serve as examples, as a great variety of different functions of 40 ( 2 ) individually connected to the switching contacts on 
the respective appliances can be controlled by way of the and off. 

speech-controlled remote control system described herein. FIG. 4 also shows that several speech channels (U0, 111, 

Hie first embodiment, which is depicted in FIG. 1, of the • • • U«) can be featured for multi-channel speech input in 

speech-controlled remote control system is particularly suit- the pc W- of course > the interface (140) has to be designed 

able when a smaller number of consumers located in a few 45 for accommodating several electro-acoustic transducers 

separate rooms are to be remote-controlled. If, however, the (™h 102, • ■ - l°m)- A hierarchy or a priority can also be 

number of consumers is larger and if the consumers are easily effected among the individual speech channels, e.g. by 

distributed over a greater distance, i.e. over several rooms of wa y of suitable software control. 

a building, for example, the effort and expense associated It goes without saying that the various embodiments of 
with the cable installation work of the remote control 50 the remote control network as shown in FIGS. 1 to 4 can also 
network is considerable. In addition, the remote control provide for parallel as well as serial transmission of the 
network may prove susceptible to malfunction in this case. infrared-encoded remote control signals. For example, 
As an alternative, FIG. 2 shows a second embodiment of mapr switching functions of the individual appliances or 
the remote control system in which the remote control units can also be transmitted via separately routed transmis- 
network features a bus topology. The principal setup of the 55 sion lines of the remote control network in order to enhance 
standard PC (1) in FIG. 2 can be the same as that shown in the reliability of the transmission of the remote control 
FIG. 1. The interface (16) leading to the remote control signals. In the variant shown in FIG. 4, in which several 
network is a bus interface. The wiring system leading to the s P eech channels are featured, the assignment of individual 
individual infrared transmitters (40) is featured as a bus (60). electro-acoustic transducers to the individual electrical con- 
This means that every infrared transmitter (40) has to feature 60 sumers being controlled can be of a functional as well as 
a receiver component for receiving the electric signals spatial nature. Of course, combinations of the features of the 
transmitted from the PC (1) via the bus (60). The remaining individual embodiments described above can also be real- 
structure of the remote control network with the infrared ized in the speech-controlled remote control system 
transmission links (3), the infrared receivers (30) and the described herein. 

cables leading to the individual electrical consumers (20) is 65 It is appreciated that the standardized infrared codeset 

identical to the network structure shown in FIG. 1. It goes may be entered, modified and assigned to a particular 

without saying that a bus topology generally offers the consumer via the PC. This advantageously enables a specific 
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codeset to be assigned to each and every consumer, with the 
codesets possibly differing from one another. Preferably, an 
image display in the form of a graphic user interface is 
generated on the PC monitor, then it can be easily assigned 
to any consumer to be remote-controlled. To be sure, said 
assignment can be made by way of the respective graphic 
appearance of this user interface. The respective speech 
commands entered can be transformed into an infrared 
codeset upon being recognized and then be graphically 
assigned to the unit to be controlled on the monitor. 
Nowadays, standard, commercially available graphic user 
interfaces routinely enable modifications to the codeset as 
well as modifications to the form of the graphic user 
interface itself to be entered by way of commands, e.g. via 
the keyboard or a mouse. In so doing, the entries made can 
be stored in a log file. In addition, an acoustic feedback can 
be generated for the user via the PC's speech output mod- 
ules. 

The PC also preferably processes complex operator con- 
trol sequences capable of being entered, stored and dis- 
played and which can be carried out at any later time desired 
in accordance with an accompanying entry. 

At the PC, a standard input device such as a keyboard can 
be used to enter and modify an infrared codeset and assign 
it to the respective electrical consumer. One or several 
electro-acoustic transducers can be connected to the speech 
channel interface of the PC, with several speech channels 
also being capable of being distributed among several 
rooms. 

Depending on the specific application of the system 
embodying the invention for speech-controlled remote 
control, the remote control network connecting to the indi- 
vidual consumers may feature a star topology or a bus 
topology. 

In addition, the remote control network may also feature 
a fiberoptic cable via which the infrared control codes may 
be transmitted directly. 

A standard, commercially available speech recognition 
system which is implemented in a standard, commercially 
available PC is suggested for speech recognition. This 
speech recognition system can convey the information 
obtained by way of speech recognition to other programs on 
the basis of the speech commands entered. This information 
is captured and compared with the possible remote control 
commands for controlling the electric consumers. As soon as 
a command is recognized, the memory is searched for this 
command, with the information being found, for example, 
that the radio is to be switched to another radio station in 
addition to the information, if necessary, indicating the room 
in which the radio is located. This is followed by the 
accompanying infrared-encoded signal being transmitted to 
the respective room and emitted there, this causing the radio 
to be switched to another radio station. 

By virtue of the process and the system embodying the 
invention it is possible to combine a speech input device 
with a sequence control in an extremely easy manner. In 
addition, the method and the system also enable a control 
sequence to be carried out in a time-delayed manner. For 
example, the riser can enter a timing sequence before going 
on vacation and program a sequence control of his choice 
based on a programmed time for the duration of his absence. 

It is appreciated that the PC monitor may be used by the 
user to check what entries have been made and when they 
were made at any time. 

It is intended that the appended claims be interpreted as 
including the embodiments discussed above, those various 
alternatives which have been described and all equivalents 
thereto. 
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What is claimed: 

1. A method for remote controlling electrical consumer 
devices in accordance with speech commands, wherein a 
personal computer (PC) and said consumer devices are 
connected to a remote control network, comprising the steps 
of: 

receiving speech commands from at least one speech 
channel having an electro-acoustic transducer, said 
transducer being connected to the PC via a speech 
channel interface; 

transforming the speech commands into a corresponding 
control commands for controlling consumer devices 
using a speech recognition program; 

encoding every control command generated by the speech 
recognition program to provide infrared codes, each 
infrared code being enterable, modifiable and assign- 
able to a respective consumer device by an operator 
using the PC; 

generating an image display on the PC in the form of a 
graphic user interface corresponding to each of said 
consumer devices to be controlled, said interface being 
assignable to a respective speech command and a 
codeset; 

transmitting said infrared codes to said respective con- 
sumer device via the remote control network; and 

transforming said infrared codes into electrical control 
signals for controlling the respective consumer device. 

2. The method of claim 1, wherein said infrared codes 
comprises codesets which are assignable to any of said 
consumer devices. 

3. The method of claim 1, further comprising the step of 
transforming said infrared codes into infrared signals and 
transmitting said infrared signals to said respective con- 
sumer device via the remote control network. 

4. The method of claim 1, further comprising the steps of: 
storing a sequence of times to transmit each of said 

infrared codes to said respective consumer device, such 
that said respective consumer device may be remote 
controlled in a time-delay manner. 

5. A system for remote controlling electrical consumer 
devices in accordance with speech commands, comprising: 

a processor having a speech recognition program for 
recognizing and transforming the speech commands 
received by a speech channel into corresponding con- 
trol command for controlling said consumer devices, 
said processor having a speech channel interface; 

at least one speech channel being connected to said 
processor via an electro- acoustic transducer and the 
speech channel interface; 

a remote control network connecting said consumer 
devices to said processor; 

an encoder for encoding every speech command gener- 
ated by said speech recognition program to provide 
infrared codes; 

a transformer for transforming said infrared codes into 
encoded signals; 

a storage device for storing said infrared codes; 

an input device for inputting and modifying an infrared 
code and assigning the modified infrared code to a 
respective consumer device; 

a monitor connected to the processor for displaying an 
image in the form of a graphic user interface, said 
graphic user interface being assignable to said respec- 
tive consumer device; 
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a transmitter for transmitting the encoded signals to said 
respective consumer device via the remote control 
network; and 

an infrared received associated with said respective con- 
sumer device for receiving the encoded signals. 

6. The system of claim 5, wherein said processor is a 
personal computer (PC). 

7. The system of claim 5, wherein said infrared code 
comprises codesets of remote control units of all consumer 
devices connectable to the remote network. 

8. The system of claim 5, wherein speech channels are 
distributed over several rooms and each speech channel is 
connected to said processor via an electro- acoustic trans- 
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ducer associated with said each speech channel and said 
speech channel interface. 

9. The system of claim 5, wherein said consumer devices 
are connected to the remote control network in a star 

5 topology. 

10. The system of claim 5, wherein said consumer devices 
are connected to the remote control network in a bus 
topology. 

11. The system of claim 5, wherein said consumer devices 
30 are connected to the remote control network by a fiber-optic 

cable. 

***** 



05/11/2004, EAST Version: 1.4.1 



